No description has been provided for this image

PyData London News Oct 2024¶

89th Meetup, hosted by Man Group¶

@PyDataLondon¶

PyData Code of Conduct¶

https://pydata.org/code-of-conduct/¶

NumFOCUS¶

  • US-based charity in support of open-source scientific computing
  • Financial and admin support for many open-source projects
  • Support for many community events
  • https://numfocus.org

PyData¶

  • Educational program by NumFOCUS
  • A global community
  • 235 groups across 80 countries world-wide
  • 239,000+ users world-wide (+23,000 per year!)
  • https://www.meetup.com/pro/pydata/
No description has been provided for this image
No description has been provided for this image

PyData London¶

  • 14,300+ members running a monthly meetup and annual conference
  • All run by volunteers
  • Propose a Talk: https://london.pydata.org/submit-a-talk/
No description has been provided for this image

Man Group¶

No description has been provided for this image
  1. The world's largest publicly traded hedge fund company

  2. Lots of open positions in both tech and research!

  3. Sponsors PyData London ❤️❤️❤️

  4. Man Group London Hackthon 2024: Open Source and Charitable Sprint Day.

    Date: Saturday 9th November

    Location: Here!

    Get involved: https://www.man.com/london-hackathon-2024

Upcoming Conferences¶

Courtesy of https://pythondeadlin.es/¶

Tonight's Schedule¶

18:30 Doors open¶

19:00 Talks start ⬅️ YOU ARE HERE¶

19:15 Talk #1 + Q&A¶

19:45 Scheduled Lightning talk¶

19:50 Break 🥂¶

20:05 Talk #2 + Q&A¶

20:35 ⚡ Lightning Talk ⚡ + 📣 Community Announcements 📣¶

20:45 to 21:00 We're done 🔜 The Banker 🍻¶

1️⃣ 📊💸 Cosmos: Translating dbt to Apache Airflow - Tatiana Al-Chueyr¶

Abstract: This talk will discuss why and how to use dbt Core and Apache Airflow, open source tools that support the development of data pipelines.

On one hand, dbt is an extremely valuable tool for analytics engineers to build data transformation pipelines with SQL. On the other hand, Apache Airflow is a consolidated orchestration platform that supports the development, scheduling, and monitoring of batch-oriented workflows written in Python.

This talk discusses benefits and reasons to use these two tools, and a few approaches to integrate them, including using the open source library Cosmos: https://github.com/astronomer/astronomer-cosmos

2️⃣ 🛠️🌐 Real-time plane-spotting with Apache Druid and Python - Hugh Evans¶

Abstract: Hidden from our eyes, aircraft in our skies are constantly transmitting data. Join us as we use some simple tech and the power of open source to fly through this data set. In this talk, see a Raspberry Pi, Apache Kafka, Apache Druid, and Python coming together for real-time data production, transport, OLAP, and interactive visualisation.

⚡ Lightning Talks ⚡¶

⚡1️⃣ Seamless array computation using ndonnx - Aditya Goel¶

⚡2️⃣ DSPy - A new way of prompting with LLM - Zhaohan Dong¶

🕊️ Tweet #pydatalondon and @pydatalondon 🦆¶